Infinite-product Markov processes

نویسندگان

چکیده

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

ON THE INFINITE ORDER MARKOV PROCESSES

The notion of infinite order Markov process is introduced and the Markov property of the flow of information is established.

متن کامل

on the infinite order markov processes

the notion of infinite order markov process is introduced and the markov property of the flow of information is established.

متن کامل

Markov processes with product-form stationary distribution

This research has been inspired by several papers on processes with inert drift [5, 6, 4, 3, 1]. The model involves a “particle” X and an “inert drift” L, neither of which is a Markov process by itself, but the vector process (X, L) is Markov. It turns out that for a number of diffusions with inert drift, the stationary measure has the product form; see [1]. The purpose of this note is to chara...

متن کامل

Average Optimality in Nonhomogeneous Infinite Horizon Markov Decision Processes

We consider a nonhomogeneous stochastic infinite horizon optimization problem whose objective is to minimize the overall average cost per-period of an infinite sequence of actions (average optimality). Optimal solutions to such problems will in general be non-stationary. Moreover, a solution which initially makes poor decisions, and then selects wisely thereafter, can be average optimal. Howeve...

متن کامل

ETAQA Solutions for Infinite Markov Processes with Repetitive Structure

We describe the ETAQA approach for the exact analysis of M/G/1 and GI/M/1-type processes, and their intersection, i.e., quasi-birth-death processes. ETAQA exploits the repetitive structure of the infinite portion of the chain and derives a finite system of linear equations. In contrast to the classic techniques for the solution of such systems, the solution of this finite linear system does not...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Transactions of the American Mathematical Society

سال: 1968

ISSN: 0002-9947

DOI: 10.1090/s0002-9947-1968-0217873-4